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strategy  selection. 

In  addition  (3)  a significant  correlation  was  obtained  between 
subjective  certainty  and  obtained  accuracy  of  the  decisions,  and 
(4)  the  value  of  making  a correct  decision  was  found  to  affect  the 
complexity  of  the  Strategy  selected  to  sclve  the  decision. 

The  results  suggest  that  people  use  a form  of  cost-benefit 
analysis  as  a basis  for  selecting  decision  strategies  and  that  their 
behavior  is  optimal  In  that  It  tends  to  maximize  the  decision  maker's 
expected  net  utility. 
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An  Experimental  Test  of  a Model  for  Decision  Strategy  Selection^ 

Beach  and  Mitchell  (1977)  have  proposed  a model  to  account  for  v/hy  decision 
makers  do  not  alv/ays  select  normatively  optimal  strategies  for  solving  decision 
problems.  The  model  posits  that  the  selection  of  a strategy  Is  contingent  upon 
characteristics  of  both  the  decision  task  and  the  decision  maker  and  that  the 
selection  mechanism  itself  consists  of  a cost-benefit  analysis:  The  strategy 
that  appears  to  offer  the  greatest  expected  net  gain  is  the  one  selected. 

Christensen-Szalanski  and  Beach  (1977)  formalized  the  strategy  selection 

mechanism  and  Figure  1 illustrates  the  hypothetical  cost  and  benefit  functions. 

The  cost  curve  represents  the  cost  to  the  decision  maker,  in  time  and  energy,  of 

using  the  various  strategies.  Because  the  cost  (U  ) of  using  a strategy  is 

6 

incurred  after  the  strategy's  selection  but  before  the  outcome  of  the  decision  is 
known,  potential  cost  must  be  balanced  against  the  potential  benefits  of  using 
the  strategy.  It  is  assumed  that  the  cost  curve  usually  is  an  increasing 
function  of  strategy  accuracy  because  a slight  relative  increase  in  strategy 
complexity  may  require  a large  absolute  increase  in  demands  upon  the  decision 
maker;  strategy  complexity  is  seen  as  linked  to  strategy  accuracy. 

For  any  given  set  of  Decision  Tufk  Characteristics  (Beach  & Mitchell,  1977) 
there  is  associated  with  each  strategy  in  the  decision  maker's  repertory  sub- 
jective probabilities  that  the  strategy  v/ill  lead  to  the  correct  decision,  P„, 
or  to  an  incorrect  decision,  l-P^*  The  utility  of  making  the  correct  decision  is 
designated  U and  the  utility  for  making  an  incorrect  decision  is  designated  U. . 

W I 

For  any  strategy  the  product  P_U  is  the  expected  benefit  if  its  use 

V C* 

results  in  a correct  decision  and  the  product  (l"Pj.)U^  is  the  expected  benefit 
(positive  or  negative)  if  it  results  in  an  incorrect  decision.  Thus,  the 
subjective  expected  benefit  of  a strategy  is  *^1 

which  Is  the  linear  function  illustrated  in  Figure  i 


Insert  Figure  1 about  here 

For  a specific  decision  task,  the  difference  betv/een  the  cost  and  the 
expected  benefit  line  is  the  net  expected  gain  from  using  a strategy  that  has 
that  particular  P of  yielding  a correct  (accurate)  decision.  The  decision 
maker  should  select  the  strategy  associated  with  the  P^  for  v;hich  this  difference 
is  maxima'i , P*,  Graphically,  P*  is  at  the  point  at  which  the  space  between  the 
cost  curve  and  the  expected  benefit  line  is  widest.  Intuitively,  P*  is  at  the 
point  at  which  the  decision  maker  thinks  he  stands  to  make  the  most  profit  for 
the  least  cost. 

Several  predictions  of  behavior  in  different  decision  situations  can  be 
generated  by  varying  the  parameters  of  the  cost  and  benefit  functions.  Figure  2a 
illustrates  that  as  the  value  of  making  a correct  decision  (U^)  increases,  the 
slope  of  the  expected  benefit  line  increases.  As  a result,  P*  changes  upward 

V 

and  the  strategy  with  the  corresponding  P becomes  the  strategy  of  choice. 

Thus,  the  decision  maker  should  both  change  strategies  and  be  subjectively  more 
confident  that  his  or  her  decision  is  the  correct  decision  as  the  value  of  making 
the  correct  decision  (U.)  increases.  , Furthermore,  because  the  cost  curve  is  an 
increasing  function  of  strategy  accuracy,  the  decision  neker  also  should  use  more 
costly  strategies  to  make  a decision  under  the'e  circumstances. 


Insert  Figure  2 about  here 

By  keeping  the  expected  benefit  line  constant  v;hile  changing  the  cost  curve 
another  predipt  ion  can  be  generated.  Assuming  that  a fatigued  decision  ri^ker 
must  put  more  time  and  effort  into  the  decision  task  with  the  consequence  that 


Hypothetical  cost  and  benefit  functions  for  various 


igure 


the  cost  curve  rises  (Figure  2b),  the  raised  cost  curve  dictates  a new  strategy, 

one  that  is  associated  with  a lower  P*.  As  a result,  the  decision  maker  should 

c 

be  less  confident  that  his  or  her  subsequent  decision  is  correct. 

The  present  experiment  tests  (1)  the  validity  of  the  assumption  that 
strategy  cost  is  an  increasing  function  of  perceived  strategy  accuracy  and  the 
predictions  that  (2)  fatigue  and  (3)  an  increase  in  the  value  of  making  a 
correct  decision  each  influence  behavior  in  the  ways  outlined  above. 

ftethod 

Participants 

Twelve  students  from  the  University  of  Uashington  business  school  partici- 
pated for  $9  each.  An  additional  $15  could  be  earned  by  the  participants 
depending  upon  their  performance. 

Procedure 

Participants  were  required  to  give  an  estimate  of  the  expected  profits  a 
hypothetical  person  might  realize  In  a situation  described  in  a written  scenario 
(see  Appendix  for  an  example).  All  secnarlos  were  constructed  such  that  only 
three  outcomes  could  possibly  occur:  One  was  very  likely  to  occur  (.6  < p < .8), 
one  was  very  unlikely  to  occur  (p  < ,1),  and  one  would  occasionally  occur 
(.2  < p < ,35). 

Each  scenario  had  a "correct  profit"  that  could  be  calculated  by  using  all 
of  the  available  information;  approximations  to  the  correct  answer  could  be 
obtained  by  relying  on  strategies  tha-:  used  part  of  the  available  information. 
Participants  had  to  decide  which  one  of  the  eight  strategies  listed  in  Table  1 
VO  use  to  arrive  at  their  estimate  of  the  correct  value.  A measure  of  partici- 
pants' confidence  In  their  estimates  was  obtained  by  having  them  place  intervals 
afound  their  estimates.  Beach  and  Splack  (1969)  have  found  these  "equivalence 


intervals"  (El)  to  be  useful  measures  of  a decision  maker's  confidence  In  answers 
to  quantitative  problems,  the  Intervals  are  both  easily  understood  by  the  decision 
maker  and  reliably  reflect  the  decision  maker's  opinion  about  the  accuracy  of 
the  answers.  Equivalence  Intervals  are  conceptually  very  similar  to  statistical 
confidence  Intervals;  as  uncertainty  Increases  the  width  of  the  equivalence 
Interval  Increases.  Furthermore,  they  have  been  shovm  to  behave  In  rough  accor- 
dance with  the  statistical  properties  of  confidence  Inter  als.  Laestadlus  (1970) 
for  example  found  that  El's  for  estimates  of  means  from  lists  of  numbers  Increased 
with  an  Increase  In  the  variance  of  the  number  on  the  list.  Similarly,  Seachv 
Beach,  Carter  and  Barclay  (1974)  observed  that  the  El's  for  proportion  estimates 
of  binomial  samples  decreased  as  the  sample  size  Increased  and  the  sample  ' 
variance  decreased.  The  participants  were  Informed  that  the  breadth  of  the 
Interval  determined  the  percentage  of  points  that  they  earned  for  that  decisipn 
and  that  the  accumulated  points  could  be  used  tov/ard  obtaining  the  $15  bonus  at 
the  conclusion  of  the  experiment.  They  also  were  told  that  to  earn  any  points 
from  the  decision  the  interval  must  contain  the  true  value.  However,  the  larger 
the  Interval  the  smaller  the  percentaqe  of  possible  points  they  could  earn  for 
that  decision. 


Insert  Table  1 about  here 


To  test  for  the  model's  predictions  of  the  shape  of  the  cost  curve,  the 
time  to  solve  each  problem'v/as  used  as  an  approximate  measure  of  strategy  cost 
to  the  participant.  This  was  arranged  by  informing  the  participants  that  the 
bonus  prizes  would  be  allocated  by  rank  of  the  subject's  ratio  of  total  points 
earned  to  the  total  time  used.  Participants  were  Instructed  to  use  as  little 
time  as  possible  v/hlle  being  as  accurate  as  possible.  This  was  done  to  encourage 
the  subjects  to  maximize  the  rate  at  which  points  were  earned. 


Table  1 


Possible  Strategies  for  Solving  Scenario  Problems 

1.  Accurately  calculate  all  three  possible  states  of  the  world 

2.  Round  and  calculate  all  throe  possible  states  of  the  world 

3.  Accurately  calculate  the  two  most  likely  states  of  the  world 

4.  Round  and  calculate  the  tm  most  likely  states  of  the  world 

5.  Accurately  calculate  only  the  most  likely  state  of  the  world 

6.  Round  and  calculate  only  the  most  likely  state  of  the  world 

7.  Guess 

8.  None  of  these 
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To  test  the  model's  predictions  of  the  effect  of  the  value  of  making  « 
correct  derision  (U  ) each  scenario  for  each  participant  was  randomly  assigned 
to  one  of  five  different  pay  scales  that  ranged  from  low  (10)  to  medium  (75,  150) 
to  high  (350,  500)  numbers  of  points.  These  numbers  of  points  were  the  upper 
limits  that  participants  could  earn  for  each  problem,  the  actual  percentage  of 
points  earned  from  each  decision  was  determined  by  their  confidence  In  their 
estimate  (the  size  of  the  interval)  and  by  the  accuracy  of  their  estimates. 
Accuracy  was  determined  by  calculating  the  absolute  difference  betvjeen  their 
estimate  and  the  true  value.  The  participants  v^ere  not  informed  either  of  the 
exact  exchange  rate  betvieen  confidence  and  the  percentage  of  points  earned,  or 
between  accuracy  and  the  percentage  of  points  earned.  They  were  only  informed 
that  an  increase  in  Interval  size  and  a decrease  in  accuracy  would  reduce  the 
percentage  of  points  earned.  At  the  conclusion  of  the  experiment,  10%  of  the 
maximum  possible  points  for  each  problem  would  be  deducted  for  every  1,000  units 
in  the  subject's  confidence  interval  and  for  every  500  units  difference  betv/een 
the  subject's  estimate  and  the  true  ansvjer.  The  sum  of  the  points  they  earned 
for  all  decisions  would  then  be  divided  by  the  total  time  they  used  to  solve  the 
decisions  to  determine  their  ranking  for  the  bonus  prize. 

Following  the  completion  of  these  instructions  each  of  the  eight  strategies 
was  explained  by  using  it  to  arrive  at  the  solution  of  a sample  problem.  The 
participants  were  then  given  up  to  15  minutes  to  review  the  instructions  and 
materials  that  had  been  presented  up  to  that  time  and  were  allowed  to  explore 
the  probable  accuracy  and  time  requirements  of  the  eight  strategies.  When  they 
were  satisfied  that  they  understood  the  task  and  the  strategies  they  were  per- 
mitted to  begin  the  experiment. 

Sessions  were  run  on  two  consejutive  days.  On  each  day  participants  were 
required  to  arrive  at  a decision  on  10  of  the  20  scenarios.  One  scenario  of 
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each  point  value  v^as  presented  in  each  half  of  the  session.  The  procedure  for 
both  days  v/as  identical  with  the  exception  that  before  one  of  the  sessions  began, 
subjects  vi/ere  required  to  search  for  randomly  generated  “target"  numbers  in  a 
series  of  random  number  tables.  This  '.aSk  lasted  for  40  minutes  and  v/as  used  to 
create  a state  of  mental  fatigue  in  the  participants  without  altering  their 
mathematical  abilities.  Half  of  the  participants  received  the  stimulus  the  first 
and  half  received  it  the  second  day. 

Results  and  Discussion 

Effect  of  the  Value  of  the  Decision  on  Confidence  and  Time 

A Hollander  (1967)  one-way  non-parametric  analysis  of  variance  was  used  to 
analyze  both  the  confidence  data  (inverse  of  interval  size)  and  time  data  used 
by  each  subject  at  each  pay  scale.  This  test  not  only  examines  v/hether  the 
samples  could  have  originated  from  the  same  population  but  also  examines  whether 
there  are  any  differences  in  an  a priori  specified  order.  As  Figures  3a  and  3b 
illustrate,  the  data  for  the  confidence  and  time  measures  are  clearly  significant 
and  in  the  predicted  order  (confidence:  z = 3.G6.  p < .001,.  time:  z * C.36, 

p < .001 ). 

Insert  Figure  3 about  here 

Effect  of  Fatigue  on  Confidence 

A Uilcoxon  signed  rank  test  was  used  to  analyze  confidence  data  for  each 
pay  scale  of  the  session  that  followed  the  random  number  task  with  the  session 
which  was  not  preceded  by  that  task.  The  difference  v/as  not  significant 
(z  » -.47,  p = .82).  A manipulation  check  revealed  failure  of  the  task  to 
produce  fatigue i only  tv/o  subjects  reported  that  the  random  number  task  was 
fatiguing. 
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A second  approach  to  fatigue  v/as  to  conpare  the  data  fror  ’•.he  first  half 
of  each  of  the  tv/o  sessions  with  those  of  the  second  half.  All  participants 
reported  that  they  felt  more  mentally  fatigued  after  each  three  hour  session 
than  when  they  began.  Uhen  these  two  sets  of  data  were  analyzed  v/lth  the 
Wilcoxon  signed  rank  test,  the  results  were  significant  in  the  predicted  direc- 
tion (Figures  4a  and  4b;  z » 1.88,  p = .03,  one-tailed  test). 

Insert  Figure  4 about  here 

Since  this  comparison  is  based  on  an  ADAB  design  It  is  possible  that 
experimental  practice  effects  and  not  fatigue  account  for  the  trend.  If  this 
viere  so  the  results  would  imply  that  people  are  less  certain  of  their  answer  as 
a result  of  more  practice.  Not  only  is  this  Illogical,  a Ullcoxon  signed  rank 
test  of  the  first  fatigue  period  compared  to  the  second  non-fatigue  period  fails 
to  show  any  practice  effects  and  supports  the  earlier  Interpretation  ( z = -.94, 

P = .83). 

Cost  Functions  and  the  Effect  of  Fatigue 

As  Figure  2a  illustrates,  the  psychological  cost  curve  can  be  mapped  by 
varying  the  expected  benefit  lines  and  fitting  a curve  to  the  points  with 
coordinates  (Pj*',  T^^),  (PjJ^,  (PjJl,  T^),  etc.;  the  best  fit  power  curves  through 
the  points  associated  with  the  mean  group  confidence  and  time  used  '"or  each  pay 
scale  for  both  the  fatigue  and  non-fatigue  conditions.  Figure  5 shows  these 
power  curves.  Assuming  an  interval  scale  of  confidence  both  of  the  cost  curves 
are  curvilinear  with  exponents  significantly  greater  than  1.0  (Normal:  Sj^  = 

.007,  t = 81.59,  df  = 3,  p < .001,  k * 100580873.  Fatigue:  « .026,  t » 25.22. 

df  * 3,  p < .001,  k = 224529562).  Furthermore,  the  fatigue  (cost)  curve 
accelerates  faster  than  the  non-fatigue  cost  curve.  This  trend,  with  only  six 


Figure  3.  The  effect  of  point  value  of  the  correct  decision  upon  (a)  mean  confidence 
n accuracy  and  (b)  mean  time  used. 


nonfatigue  conditions  and  (b)  point  values  of  correct  so 
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"U” 

degrees  of  freedom  and  using  tirtie  as  an  approximation  of  cost  is  significant  at 
the  p » .09  level  = .045,  t ■ 1.511)t 

Insert  Figure  5 about  here 

Effect  of  the  Decision  Value  on  Strategy  Complexity 

Beach  and  Mitchell  (1977)  suggest  that  in  western  cultures  most  people 
believe  that  the  more  thoroughly  and  systematically  one  approaches  a decision  the 
greater  the  chance  of  being  correct.  This  v/ould  imply  that  more  thorough  and 
complex  strategies  would  be  used  for  more  valuable  decisions.  A Hollander  Anova 
was  used  to  analyze  the  complexity  of  the  strategies  used  for  each  pay  scale. 

The  eight  strategies  in  Table  1 can  be  assigned  3,  2,  1,  or  0,  depending  upon 
whether  they  required  the  use  of  3,  2,  1,  or  0 (guess)  pieces  of  information  to 
solve  for  the  solution.  (Only  tm  subjects  reported  using  "none  of  these"  and 
in  all  four  Instances  the  strategies  v;ere  described  as  a combination  of  accurately 
calculating  three  factors  and  rounding  three  factors:  They  received  a 3.) 

Figure  6 shows  that  significantly  wiore  complex  strategies  tended  to  be  used  to 
calculate  more  valuable  decisions  (z  * 5.62,  p < .001).  Although  this  relation- 
ship Is  not  predicted  by  the  Christensen-Szalanski  and  Beach  (1977)  formulation, 
its  presence  suggests  that  for  quantitative  problems  of  the  variety  used  here  the 
Beach  and  Mitchell  (1977)  suggestion  is  valid. 


Insert  Figure  6 about  here 


Subjective  Calibration  of  Uncertainty 

To  compare  whether  subjects  were  consistent  in  assessing  their  uncertainty, 
as  determined  by  the  size  of  their  interval,  a Spearman  rank  order  correlation 
v^as  used  to  compare  the  group's  mean  interval  size  for  each  of  the  five  pay 


Figure  5.  Best  fit  power  functions  for  mean 
fatigue  and  nonfatigue  conditions. 


Mean  No.  of  factors 
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Appendix  1 

Sample  of  Scenarios  Presented  lo  Subjects 

Because  of  past  trends  an  investor  believes  that  his  qains  from  stocks  on 
the  stock  exchange  v/ill  depend  upon  whether  the  banks  raise  their  lending  rate. 
There  is  a 622  chance  of  the  banks  lowering  their  lending  rate  from  its  present 
value,  a 31%  chance  of  the  banks  keeping  the  same  lending  rate,  and  a 7%  chance 
that  they  will  increase  their  lending  rate. 

If  the  lending  rate  goes  dovin  there  is  a 71%  chance  of  earning  $27,752,  a 
23%  chance  of  earning  $16,389.  and  a 6%  chance  of  earning  $2,477. 

If  the  lending  rate  remains  the  same  there  is  a 2j[^  chance  of  earning 
$27,752,  a 5^  chance  of  earning  $16,389,  and  a 16%  chance  of  earning  $2,477. 

If  the  lending  rate  increases  there  is  a 14%  chance  of  earning  $27,752,  a 

19%  cliance  of  earning  $16,389,  and  a 67%  chance  of  earning  $2,477. 

\ 

What  is  the  investor's  expected  profit?  

What  are  your  upper  and  lovier  estimates?  to 
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